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Abstract 

Monotone systems constitute one of the most important classes of dynamical systems used in 
mathematical biology modeling. The objective of this paper is to extend the notion of monotonicity 
to systems with inputs and outputs, a necessary first step in trying to understand interconnections, 
especially including feedback loops, built up out of monotone components. Basic definitions and 
theorems are provided, as well as an application to the study of a model of one of the cell's most 
important subsystems. 



1 Introduction 

One of the most important classes of dynamical systems in theoretical biology is that of monotone 
systems. Among the classical references in this area are the textbook by Smith p3] and the papers [jl4| 
p^[ | by Hirsh and |^3| by Smale. Monotone systems are those for which trajectories preserve a partial 
ordering on states. They include the subclass of cooperative systems (see e.g. @, H for recent 
contributions in the control literature) , for which different state variables reinforce each other (positive 
feedback) as well as more general systems in which each pair of variables may affect each other in 
either positive or negative, or even mixed, forms (precise definitions are given below). Although one 
may consider systems in which constant parameters (which can be thought of as constant inputs) 



appear, as done in the recent paper 22 for cooperative systems, the concept of monotone system 
has been traditionally defined only for systems with no external input (or "control" ) functions. 

The objective of this paper is to extend the notion of monotone systems to systems with inputs 
and outputs. This is by no means a purely academic exercise, but it is a necessary first step in 
trying to understand interconnections, especially including feedback loops, built up out of monotone 
components. 

The successes of systems theory have been due in large part to its ability to analyze complicated 
structures on the basis of the behavior of elementary subsystems, each of which is "nice" in a suitable 
input/output sense (stable, passive, etc), in conjunction with the use of tools such as the small gain 
theorem to characterize interconnections. 

On the other hand, one of the main themes and challenges in current molecular biology lies in 
the understanding of cell behavior in terms of cascade and feedback interconnections of elementary 
"modules" which appear repeatedly, see e.g. Our work reported here was motivated by the 

problem of studying one such module type (closely related to, but more general than, the example 
which motivated p7j]), and the realization that the theory of monotone systems, when extended 
to allow for inputs, provides an appropriate tool to formulate and prove basic properties of such 
modules. 
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The organization of this paper is as follows. In Section [2[ we introduce the basic concepts, 
including the special case of cooperative systems. Section || provides infinitesimal characterizations 
of monotonicity, relying upon certain technical points discussed in the Appendix. Cascades are the 
focus of Section ^, and Section || introduces the notions of static Input/State and Input/Output 
characteristics, which then play a central role in the study of feedback interconnections and a small- 
gain theorem in Section [| We return to the biological example of MAPK cascades in Section [t| 
Finally, Section ^ shows the equivalence between cooperative systems and positivity of linearizations. 

We view this paper as only the begining of a what should be a fruitful direction of research into 
a new type of nonlinear systems. In particular, in a follow-up paper 0, we present results dealing 
with more general feedback interconnections than those considered in this paper, as well as graphical 
criteria for monotonicity. 



2 Monotone Systems 

Monotone dynamical systems are usually defined on subsets of ordered Banach (or even more general 
metric) spaces. An ordered Banach space is a real Banach space B together with a distinguished 
nonempty closed subset A of B, its positive cone. (The spaces B which we study in this paper will 
all be Euclidean spaces; however, the basic definitions can be given in more generality, and doing 
so might eventually be useful for applications such as the study of systems with delays, as done 



in 1 24 for systems without inputs.) The set A is assumed to have the following properties: it is 
a cone, i.e. a A C A for a G R + , it is convex (equivalently, since A is a cone, A + A C A), and 
A n (—A') = {0}. An ordering is then defined by x\ >z X2 iff X\ — X2 G A. Strict ordering is denoted 
by X\ >- X2, meaning that Xi >z xi and X\ ^ x%. One often uses as well the notations -< and ^, in the 
obvious sense (x-2 < x\ means x\ >z x-x). (Most of the results discussed in this paper use only that 
A is a cone. The property A n (—A) = {0}, which translates into reflexivity of the order, is never 
used, and the convexity property, which translates into transitivity of the order, will be only used in 
a few places.) 

The most typical example would be B = K™ and A = R> , in which case u x\ >z £2" means that 
each coordinate of Xi is bigger or equal than the corresponding coordinate of x^.- This order on state 
spaces gives rise to the class of "cooperative systems" discussed below. However, other orthants in 
W 1 other than the positive orthant A = M™ are often more natural in applications, as we will see. 

In view of our interest in biological and chemical applications, we must allow state spaces to 
be non-linear subsets of linear spaces. For example, state variables typically represent concentra- 
tions, and hence must be positive, and are often subject to additional inequality constraints such as 
stoichiometry or mass preservation. Thus, from now on, we will assume given an ordered Banach 
space B and a subset X of B which is the closure of an open subset of B. For instance, X = B, 
or, in an example to be considered later, B = R 2 with the order induced by A = R>o x M<o, and 
X = {(x, y) G R 2 I x > 0, y > 0, x + y < 1}. 

We start by recalling the standard concept of monotonicity for uncontrolled systems. 

Definition 2.1 A dynamical system <f> : R>o X X — > X is monotone if the implication below holds: 

x\>X2 => 4>{t, x\) y 4>(t, X2) Vi > . □ 

If the interior of the positive cone A is nonempty (as is often the case in applications of mono- 
tonicity), one can also define a stricter ordering: x\ 3> X2 44> x — y G int(A). (For example, when 
A = M> , this means that every coordinate of x\ is strictly larger than the corresponding coordinate 
of X2, in contrast to u xi >- £2" which means merely that some coordinate is strictly bigger while the 
rest are bigger or equal.) Accordingly, one says that a dynamical system <f> : R>o x X — > X is strictly 
monotone if x± >- X2 implies that (f>(t,xi) S> <f>{t 1 X2) for all t > 0. 

Inputs 

Next we generalize, in a very natural way, the above definition to controlled dynamical systems, i.e., 
systems forced by some exogenous input signal. In order to do so, we assume given a partially ordered 
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input value space U. Technically, we will assume that U is a subset of an ordered Banach space My. 
Thus, for any pair of input values u\ and ui G L(, we write ui y U2 whenever u\ — U2 G K u where 
K u is the corresponding positivity cone in B^. 

By an "input" or "control" we shall mean a Lebesgue measurable function m(-) : M>o — > U which 
is essentially bounded, i.e. there is for each finite interval [0, T] some compact subset CCU such 
that u(t) G C for almost all t G [0, T], We denote by i4o the set of all inputs. Accordingly, given two 
Ui,u 2 G Uoe, we writej] 

til t ^2 Wl(*) b u 2(^) V t > . 

A controlled dynamical system is specified by a state space A as above, an input set U, and a mapping 
: M>o x A x Woo — > X such that the usual semigroup properties hold. (Namely, 4>(0, x,u) — x and 
4>{t, 4>{s, x, Mi), u%) = 4>{s + t, x, v), where v is the restriction of u\ to the interval [0, s] concatenated 
with the restriction of U2 to [s, oo); we will soon specialize to solutions of controlled differential 
equations.) 

We interpret (f>(t, £, u) as the state at time t obtained if the initial state is £ and the external 
input is u(-). Sometimes, when clear from the context, we write u x(t, £, u)" or just "x(t)" instead of 

£, m). When there is no risk of confusion, we use "x" to denote states (i.e., elements of A) as well 
as trajectories, but for emphasis we sometimes use £, possibly subscripted, and other Greek letters, 
to denote states. Similarly, "m" may refer to an input value (element of IX) or an input function 
(element of Woo). 

Definition 2.2 A controlled dynamical system (j> : R>oxAxWoo — ► A is monotone if the implication 
below holds: 

Mi y M2, x\ y x 2 => 4>(t, x±,ui) y <t>{t, x 2 ,u2) v t > o . n 

Viewing systems with no inputs as controlled systems for which the input value space U has just 
one element, one recovers the classical definition. 

One may also, of course, define strictly monotone controlled dynamical systems, by analogy with 
the concept defined for systems with no inputs. 

Outputs 

We will also consider monotone systems with outputs y — h(x). These are specified by a controlled 
monotone system <j> together with a monotone [x\ y £2 =>■ h{x\) y h(x2)) map h : A — » y, where 
y, the set of measurement or output values, is a subset of some ordered Banach space My. We often 
use the shorthand y(t,x,u) instead of h(cj)(t,x,u)), to denote the output at time t corresponding to 
the state obtained from initial state x and input u. 

Systems without inputs 

For each constant input signal u(t) = u, a controlled monotone dynamical system behaves as a 
classical monotone dynamical system. This allows application of the rich theory developed for this 
class of systems. For example, for strictly monotone dynamical systems, the following properties are 
satisfied (see ]24|] for precise statements and proofs): 

• For a, b G A, with b >- a, let [a, b] = {x G A : b y x y a}. If a and b are equilibria for a strongly 
monotone system <f> and <p([a, b], t) is relatively compact for alH > then one of following three 
alternatives must hold: 

(i) all trajectories with b y x y a converge to a; 

(ii) all trajectories with b y x y a converge to b; or 

(iii) there exists an equilibrium c with a y c y b 
(order interval trychotomy, |2(], g4]). 

• If all semiorbits have compact closures, then convergence (as t — » +00) to the set of equilibria 
is in some sense "generic" (see |H). 

To be more precise, this and other definitions should be interpreted in an "almost everywhere" sense, since inputs are 
Lebesgue-measurable functions. 
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• Periodic orbits cannot be stable. 

• A theorem of Smale shows that arbitrarily complex dynamics can arise on unstable n — 1 
dimensional invariant subsets of monotone systems. 

We will study generalizations of some of these properties to controlled monotone systems in forth- 
coming work. 

Systems defined by differential equations 

From now on, we will specialize to the case of systems defined by differential equations with inputs: 



(see ]26| for basic definitions and properties regarding such systems). We make the following technical 
assumptions. The map / is defined on X x U, where X is some open subset of B which contains 
X, and B = W 1 for some integer n. We assume that f(x,u) is continuous in (x, u) and locally 
Lipschitz continuous in x locally uniformly on u. This last property means that for each compact 
subsets C\ C X and C2 C U there exists some constant k such that u) — f((,u)\ < |£ — CI f° r 
all £, C G C\ and all u G C%. In order to obtain a well-defined controlled dynamical system on X, 
we will assume that the solution x(t) = <p(t, xq, u) of x = f(x, u) with initial condition x(0) — xq is 
defined for all inputs u(-) and all times t > 0. This means that solutions with initial states in X must 
be defined for all t > (forward completeness) and that the set X is forward invariant. (Forward 
invariance of X may be checked using tangent cones at the boundary of X, see the Appendix.) 
From now on, all systems will be assumed to be of this form. 

3 Infinitesimal Characterizations 

For systems (Q) defined by controlled differential equations, we will provide an infinitesimal char- 
acterization of monotonicity, expressed directly in terms of the vector field, which does not require 
the explicit computation of solutions. Our result will generalize the well-known Kamke conditions, 
discussed in p4j , Chapter 3. We denote V := int X, the interior of X (recall that X is the closure 
V) and impose the following approximability property (see p4| , Remark 3.1.4): 

for all £i,£2 G X such that £1 y £2, there exist sequences {£!}, {£2} V 
such that {;{ y C2 for all i and £| — > £1 and £2 £2 as i —> 00. 

Remark 3.1 The approximability assumption is very mild. It is satisfied, in particular, if the set X is 
convex, and, even more generally, if it is strictly star-shaped with respect to some interior point £», i.e., 
for all £ G X and all < A < 1, it holds that A£ + (1 — A)£* G V. (Convex sets with nonempty interior 
have this property with respect to any point G V, since A£+(l — A)£* G Q :— A£+(l — A)V C X (the 
inclusion by convexity) and the set Q is open because 77 1— > A£+(l— A)?y is an invertible affine mapping.) 
Indeed, suppose that £1 — £2 G K, pick any sequence A 1 / 1, and define := A l £j + (1 — A l )£* for 
j = 1, 2. These elements are in V, they converge to £1 and £2 respectively, and each £\ — £2 = A*(£i —£2) 
belongs to K because K is a cone. Moreover, a slightly stronger property holds as well, for star- 
shaped X, namely: if £1,^2 G X are such that £1 ^ £2 and if for some linear map L : E™ — ► M 9 it 
holds that L£i = L£ 2 , then the sequences {£1}, {£2} can be picked such that L£\ = for all i; this 
follows from the construction, since L(^\ —£2) = — C2) = 0. For instance, L might select those 

coordinates which belong in some subset I C {1, . . . , n). This stronger property will be useful later, 
when we look at boundary points. □ 

The characterization will be in terms of a standard notion of tangent cone, studied in nonsmooth 
analysis, which we introduce next. 

Definition 3.2 Let S be a subset of a Euclidean space, and pick any £ G <S. The tangent cone to S 
at £ is the set 



x = 



f(x,u) 



(1) 
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where means that £j — > £ as i — > oo and that & € 5 for all i. □ 

<s 

Several properties of tangent cones are reviewed in the Appendix. The main result in this section 
is as follows. 

Theorem 1 The system ^) is monotone if and only if, for all £i,£ 2 £ V: 

Zx h £2 and m h =>• f(€i,ui)-f(&,u 2 ) GT^ 2 K (2) 

or, equivalently, 

£1 - 6 G dK and u x h it 2 =*> /(&, ui) - /(&, "2) G T^- i2 K . (3) 



The proof will be given in Section 3.5; first, we discuss the applicability of this test, and we 
develop several technical results. 

3.1 Orthants 

We start by looking at a special case, namely K — R" and K u = M™ (with B^ = K m ). Such 
systems are called cooperative systems. 

The boundary points of K are those points for which some coordinate is zero, so "£1 —£26 dK" 
means that £1 >; £2 and Zl = £2 f° r at least one i 6 {1, . . . , n}. On the other hand, if £1 >z £2 and 
£1 = £2 f° r * e ^ and £1 > £2 f° r * £ {!>■■■! n } \ I i the tangent cone T^^^K consists of all those 
vectors u = (i>i, . . . , v n ) £ M n such that Vi > Q for i £ I and Vi is arbitrary in R otherwise. Therefore, 
Property (^) translates into the following statement: 

£1 h 6 and g = £ 2 and => f Ui ) > J 1 (6, "2) (4) 

holding for all z = 1, 2, ... n, all «i, it 2 G U, and all £1, £2 G V (where /* denotes the ith component 
of /). In particular, for systems with no inputs 

x = f(x) , (5) 

one recovers the well-known characterization for cooperativity (cf . |24|] ) : 

£1 h& andg = => /*($!)>/'(&) (6) 

must hold for alH = 1, 2, . . .n and all £1, £2 G V. 

When X is strictly star-shaped, and in particular if X is convex, cf. Remark |3.l| , one could 
equally well require condition (jij) to hold for all £1,^2 G X. Indeed, pick any £1 y £2, and suppose 
that Zi — £2 f° r * G / and £J > £2 f° r * e {1> • • • > n } \ I- P^ck sequences — * £1 and £2 — » £2 so 
that, for all fc, £1,^2 G V, £f b £2 and (£f) 1 = (£f) 1 for i e I (this can be done by choosing an 
appropriate projection L in Remark |3.l|) . Since the property holds for elements in V, we have that 
f % (£i> u i) > f l {£,2> u 2) f° r all fc = 1,2, ... and all i 6 7. By continuity, taking limits as k — *• 00, we 
also have then that > / s (£2,u 2 ). On the other hand, if U also satisfies an approximability 

property, then by continuity one proves similarly that it is enough to check the condition (^) for 
ui, U2 belonging to the interior W = intW. In summary, we can say that if X and U are both convex, 
then it is equivalent to check condition (pj) for elements in the sets or in their respective interiors. 

One can also rephrase the inequalities in terms of the partial derivatives of the components of /. 
Let us call a subset S of an ordered Banach space order- convex ("p-convex" in [p4[) if, for every x 
and y in S with x > y and every < A < 1, the element Air + (1 — X)y is in S. For instance, any 
convex set is order-convex, for all possible orders. We have the following easy fact, which generalizes 
Remark 4.1.1 in @: 

Proposition 3.3 Suppose that B^ = R. m , U satisfies an approximability property, and both V and 
W = int U are order-convex (for instance, these properties hold if both V and U are convex). Assume 
that / is continuously differentiable. Then, the system (|l|) is cooperative if and only if the following 
properties hold: 

dP 

-^(x,tt)>0 Vi g V, Vu 6 W, Vi ^ j (7) 

OX-* 
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and 



dP 

-^-{x, ii)>0 Vi6l,V«£W (8) 



for all i £ {1,2,. ..ti} and all j G {1,2,... m}. 

Proof. We will prove that these two conditions are equivalent to condition (|J) holding for all i = 
1, 2, ... ti, all ui,u 2 G W, and all £i, £2 € V. Necessity does not require the order-convexity assump- 
tion. Pick any £ G V, it £ W, and pair i / j. We take £1 = £, ui = ita = it, and 62(A) — C+Ae^, where 
ej is the canonical basis vector having all coordinates ^ j equal to zero and its jth coordinate one, with 
A < near enough to zero so that £2 (A) G V. Notice that, for all such A, £1 >: £2 (A) and £f = £2 (A) 1 
(in fact, £f = £ 2 (A) £ for all £ ^ j). Therefore condition (§ gives that f (£i,u) > /'(^(A),^) for 
all negative A « 0. A similar argument shows that / l (£i,it) < / J (£;2(A), u) for all positive A w 0. 
Thus / 1 (<S;2(A), it) is increasing in a neighborhood of A = 0, and this implies Property (0). A similar 
argument establishes Property (^). 

For the converse, as in 0], we simply use the Fundamental Theorem of Calculus to write 

/*&,«!) ui) = +K&- ft), (9) 



and 



/*(£», ttoWCfc.ui) = / 1 £|^(6,U2 + rK- U i))( M J 2 - U i)dr (10) 

for any i = 1, 2, . . . n, ui,u 2 G W, and £1, £2 G V. Pick any i G {1, 2, . . . n}, u 1; u 2 G W, and £1, £2 G V, 
and suppose that £1 X £ 2 , Q — £2, and «i y 112 We need to show that /'(ft, "2) < / J (ft,wi). Since 
the integrand in (||) vanishes when j = i, and also dp/dx^ > and ^ — ft? < for j ^ i, it follows 
that / l (ft,«i) < / z (ft,ui)- Similarly, Formula ( |To| ) gives us that / l (ft,U2) < / J (ft,wi), completing 
the proof. I 

For systems (||) without inputs, Property ([j]) is the well-known characterization > for all 
i ^ j" of cooperativity. Interestingly, the authors of Q use this property, for systems as in (|l]) 
but where inputs u are seen as constant parameters, as a definition of (parameterized) cooperative 
systems, but monotonicity with respect to time- varying inputs is not exploited there. The terminology 
"cooperative" is motivated by this property: the different variables x 1 have a positive influence on 
each other. 



Other orthants 

More general orthants can be treated by the trick used in Section 3.5 in |24|]. Any orthant K in W 1 
has the form 

K (£ ) = {x G R" I {-If^xi > , i = 1, . . . ,n} 

for some binary vector e = (ei, ...,£„) G {0, 1}™. Note that = PM.™ , where P : R" -> R n 

is the linear mapping given by the matrix P — diag ((— l) ei , . . . , (— l) e "). Similarly, if the cone 
K u defining the order for U is an orthant K^ s \ we can view it as QR> , for a similar map Q = 
diag ((— l) Sl , . . . , (— l) 5m ). Monotonicity of x = f(x,u) under these orders is equivalent to mono- 
tonicity of z — g(z,v), where g(z,v) = Pf(Pz,Qv), under the already studied orders given by R™ 
and R> Q . This is because the change of variables z(t) = Px(t), v(t) = Qu(t) transforms solutions of 
one system into the other (and viceversa), and both P and Q preserve the respective orders (ft >z £2 
is equivalent to (Pft) 1 > (-Pft) 1 f° r au * G { 1 , . . . , rz} , and similarly for input values). Thus we 
conclude: 

Corollary 3.4 Under the assumptions in Proposition |3.3| , and for the orders induced from orthants 
and K^ s \ the system (|j) is monotone if and only if the following properties hold: 

BP 

J_(a; )U ) >0 VieV,VweW, Vi^j (11) 
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and 



d P 

u) > Viel.VueW 



for all i £ {1,2,. ..ti} and all j G {1,2,... m}. 



(12) 
□ 



3.2 An example 

Let us clarify the above definitions and notations with an example. We consider the partial order y 
obtained by letting K — R<o x R>o- Using the previous notations, we can write this as K — K^ e \ 
where e — (1,0). We will consider the input space U = R>o, with the standard ordering in R (i.e., 
K u = R> , or K u = with 6 = (0)). 

Observe that the boundary points of this cone K are those points of the forms p = (0, a) or q = 
(—a, 0), for some a > 0, and the tangent cones are respectively T p K = R<o x R and T p K = R X R>o, 
see Fig. ffl. Under the assumptions of Corollary a system is monotone with respect to these orders 



K 



\ 
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Figure 1: Example of cone and tangents 
if and only if the following four inequalities hold everywhere: 

df 1 „ Of 2 n Of 1 n df 2 n 
7 T2<0,-^ T <0,^<0, 1 ^>0. 
ox ox ou ou 

A special class of systems of this type is afforded by systems as follows: 



x 1 = -udiix 1 ) + 2 (1 - x 1 - x 2 ) 
± 2 = u e 3 (l -x 1 - x 2 ) -6> 4 (a; 2 ) 



= f{x\x\u) (13) 



where the functions O^s are C 1 increasing functions such that #i(0) = 0. The system is regarded as 
evolving on the triangle 

X = A := {[x,y] :x>0,y> 0,x + y< 1} 

which is easily seen to be invariant for the dynamics. The following fact is immediate from the above 
discussion: 

Lemma 3.5 The system (jl^) is monotone with respect to the given orders. □ 
3.3 Competitive systems 

A related class of dynamical systems are competitive systems; these are usually defined, for differential 
equations as in (^|), by the condition Z~ < for all i ^ j . One way of understanding such a condition 
is by noticing that a system is competitive if and only if its "reversed time" version, x = —f(x), is 
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cooperative. More generally, for generic partial orders y , we can think of systems with "competitive 
dynamics" w.r.t y, according to the following definition: 

x x h x 2 => <f>(t,X!) h 4>(t,x 2 ) Vt<0. (14) 

We point out that systems with "competitive dynamics" need not be monotone dynamical systems 
(in forward time); therefore, all the "good" properties concerning w-limit sets and convergence to 
attractors mentioned earlier are not necessarily true (although analogous statements are possible 
concerning their a-limit sets and asymptotic behavior of trajectories as t — > — oo). 

As it turns out to be useful in applications, we explicitly give the definition of controlled competitive 
system: 

Definition 3.6 A controlled dynamical system <f> : R> x A x Cu — > A is monotone in backward 
time (or has competitive dynamics) if the implication below holds: 

Ul >: U 2 , X\ h X2 => (j)(t,Xi,Ui) >z (f)(t,X 2> U 2 ) v< < o. □ 

The following infinitesimal characterization of "competitivity" follows looking at (^|) backwards 
in time: 

& - £2 6 dK and m h u 2 f(^ 2 ,u 2 )-f{^i,u 1 )eT^_^K 

In particular, when K and K u are the n and m dimensional positive orthants, and under the 
assumptions in Proposition |3.3| , we obtain the following differential characterization of controlled 
competitive systems: 

dP 

together with 

■7^(x,u) < Vx 61, Mu 6 U 
for all i £ {1,2,. ..ti} and all j G {1,2,... m}. 

3.4 Preliminaries on invariance 

We now return to the proof of Theorem [l[ 

Lemma 3.7 The set V is forward invariant for (|l|), i.e., for each £ g V and each u G Uoo, 4>{t, £, u) G V 
for all t > 0. 

Proof. Pick any £ G V, u G Woo, and to > 0. Viewing ([!]) as a system defined on an open set of states 
X which contains X, we consider the mapping a : V — -> B given by a(a;) = 4>(ta, x, u) (with the same 
11 and t ). The image of a must contain a neighborhood W of £' = a(£); see e.g. Lemma 4.3.8 in |f26f . 
Thus, W CX, which means that £' G int A, as desired. I 



Remark 3.8 The converse of Lemma |3.7| is also true, namely, if x — f(x, u) is a system defined on 
some neighborhood X of X and if V = int A is forward invariant under solutions of this system, then 
X is itself invariant. To see this, pick any £ G A and a sequence — > £ of elements of V. For any 
i, and w, 4>(t,S, l ,u) G V, so (j>(t,£,u) = lim^oo 0(i,£ l ,u) G clos V = A. □ 

We introduce the following subset of A x A: 

T := Ax A la h6} 

(we use row-vector notation, for notational simplicity) as well as the set 

U [2] := {(u!,u 2 ) eU xU \ u 1 yu 2 } 
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and observe that T is a closed subset since the defining condition means that £1 — £2 G K, and K is 
closed, and similarly W 2 ' is also closed. Next we consider the system with state-space X x X and 
input- value set UP whose dynamics 

x = f [2] (x,u) (15) 
are given, in block form using x = {x\, X2) £ X x X and u = (ui, u 2 ) G lfi 2 \ as: 

xi = f(x 1 ,u 1 ) 

rn] 

(two copies of the same system, driven by the different u^s). We denote by the set of all possible 
inputs to this composite system, i.e. the set of al l Lebesgue-measurable locally essentially bounded 
functions u : [0, 00) — > 14^. Since by Lemma 3/7 the interior V of X is forward invariant for ([!]), it 
holds that <jP^ (t, £, u) belongs to V x V whenever (eVxV and u G USJ . 

Observe that the definition of monotonicity amounts to the requirement that: for each £ G T , 
and each u G the solution <p^(t,^,u) of |7^J with initial condition x(0) — £ belongs to T for all 

t > (forward invariance of T with respect to (|l5[)). 

The set: 

T := rf|(Vx V) 

is closed relative to V x V. The following elementary remark will be very useful: 

Lemma 3.9 The system (Q) is monotone if and only if the set To is forward invariant for the 
system ( |l5| ) restricted to V X V. 

Proof. We must show that monotonicity is the same as: 

£er andwez4^ ct) [2] {t^,u) e r vt > o. (16) 

Necessity is clear, since if the system is monotone then (j>^ (i, £, it) 6 T holds for all £ G T D To and 
all t > 0, and we already remarked that (jP^ (t, £, u) G V x V whenever £ G To. Conversely, suppose 
that (|l^) holds. Pick any £ G T. The approximability hypothesis provides a sequence {£*} C To such 
that £ l — ► £ as i — ► 00. Fix any u G and any t > 0. Then <^ 2 1 (£, £ l , u) G To C T for all i, so taking 
limits and using continuity of (jP on initial conditions gives that (jP (t, £, u) G T, as required. I 

Lemma 3.10 For any £ = (£1,^2) G To and any u = (1*1,1/2) G U^ 2 \ the following two properties 
are equivalent: 

/(fc,ui)-/(&,U2) G %_ 4a A- (17) 

/i 2 i(£, u ) g r 5 r . (is) 



Proof. Suppose that (17) holds, so there are sequences U \0 and {rf} C if such that 77* — > ^1 — £2 
and 

7 fa'- (&-&)) - /(ei,«i)-/(6,«a) asi^oo. (19) 

Since V is open, the solution a;(i) = </>(i, £1, u) of x = f(x, u) with input u = u\ and initial condition 
x(0) = £1 takes values in V for all sufficiently small t. Thus, restricting to a subsequence, we may 
without loss of generality assume that £J := x(tj) is in V for all i. Note that, by definition of solution, 

r - asz^cx). (20) 

H 

Subtracting ^ from @), we obtain: 

7(^2-6) - /(6,«2) asi->oo (21) 

with £2 : — £1 ~ if- Since £j — *• £1 and 77* — > £1 — £2 as i — > 00, the sequence £2 converges to £2 G V. 
Using once again that V is open, we may assume without loss of generality that Q € V for all i. 
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Moreover, Q — £| = if G ^> i- e -j £* : — (^l)Ca) 6 ^ f° r an h which means that is in To for all i, 
and, from © and @): 

7(f -0 - (/(Ci,«i),/(6,«2)) asz^oc (22) 



so that Property ( |18[ ) is verified. Conversely, if Property (18) holds, then there are sequences U \ 
and := (^1,^2) e r such that (^) holds, and then, coordinatewise, we have both ( po| ) and ([HI), 
which subtracted and defining rf := £] — £J give ([ji]); this establishes Property (|l7|). I 

3.5 Proof of Theorem |l| 

Suppose that the system (nh is monotone, and fix any input-value pair u° = (u?,^) G U^. 



Lemma 3.9 says that the set Tq is forward invariant for the system <\la) restricted to V x V. This 



implies, in particular, that every solution of the differential equation 

with x(0) G To remains in T for all t > (where we think of u° as a constant input). We may 
view this differential equation as a (single-valued) differential inclusion x G F{x) on V x V, where 
F(£) = {f^(S,,u )}, for which the set To is strongly invariant. Thus, Theorem || in the Appendix 
implies that F(£) C for all £ G Pp. I n other words, Property ( |l8|) holds, at all £ G To, for the 
given u = u°, and hence, by Lemma 3.1C| , /(£i,tti) — /(£2,ttP,) e ^fi-fo-^ f° r au (^1^2) G Tq and 



this it . As u° was an arbitrary element of U^ 2 \ Property @ follows. 

Conversely, suppose that (J2J) holds. By Lemma 3.10| , we know that Property (18) holds for all 



(£1,^2) G To and all (111,112) G U^. To show monotonicity of the system ([t|), we need to prove that 
To is invariant for the system ( |l5| ) when restricted to V x V. So pick any £° G r , any u° G u£ ] , 
and any t° > 0; we must prove that (jP^ (t°, £°, u°) G r . The input function u° being locally 
bounded means that there is some compact subset C QU such that u(t) belongs to the compact 
subset lJ§ = UWf)C xCofB»xlu, for (almost) all t G [0,t ]. We introduce the following 
compact- valued, locally bounded, and locally Lipschitz set-valued function: 



FciO ■■= {/ [2l (^)l«e4 21 } 



on V x V. We already remarked that Property @ holds, i.e., {f [2] (£,u) I it G U^} C 7" e r , for all 
(£1^2) G To, so it is true in particular that Fc(£) Q T^T Q . Thus, Thcorem||in the Appendix implies 
that Tq is strongly invariant with respect to Fc- Thus, since x 

(•) = <P [2] (-^°,u°) restricted to [0,t°] 

satisfies x G Fc(x), we conclude that x(t°) G To, as required. 

Finally, we show that (||) and (^) are equivalent. Since (^) is a particular case of (||), we only 
need to verify that /(£i,ui) — /(£2,i<2) G T^-^K when £1 — £2 G intif. This is a consequence of 
the general fact that T^S = R" whenever £ is in the interior of a set S. I 

4 Cascades of monotone systems 

Cascade structures with triangular form 

±1 = fi(xi,x 2 ,...,x N ,u) 

X2 = h{x2, ■ ■ ■ ,XN,u) 

>' _ ' t ( x (23) 

XN = fN(x N ,u) 



are of special interest. A simple sufficient condition for monotonicity of systems (23) is as follows 
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Proposition 4.1 Assume that there exist positivity cones K\, K2, ■ ■ ■ , Km+i (of suitable dimen- 
sions) so that each of the Xi-subsystems in ( p3| ) is a controlled monotone dynamical system with 
respect to the ^-induced partial order (as far as states are concerned) and with respect to the 
iCi+i, . . • , -Kjv+i-induced partial orders as far as inputs are concerned. Then, the overall cascaded 
interconnection ( p3| ) is monotone with respect to the order induced by the positivity cone K\ x K2 x 
. . . x Kn on states and K^+i on inputs. 



Proof. Wc first prove the result for the case N = 2: 



Xi 



fi{xi,x 2 ,u) 

f2{x 2 ,u) . 



(24) 



Let >zi and >Z2 be the partial orders induced by the cones K\,K 2 and hu on inputs. Pick any two 
inputs u a > u u b . By hypothesis we have, for each two states £ a = (CiiCf) an d £, b = (Ci 7 €2) : 



as well as, for all functions x 2 ,x 2 

£? hi & A hi x\ 

Combining (p5h and (|2^) yields 



& h2 & <Mt,£f,0 h2 02(*,S,« 6 ) vt > 
6. 



Mt>ti,*2,v a )tiMUi,4>u b ) vt>o. 



(25) 
(26) 



& hi £ & c 2 h2 e 2 



C hi & & Mt,Q,u a ) h2 Mt,&u") Vi > 



=► 0i(t,ff ,xlu a ) hi 0i(f,& x b 2 ,u b ) & 02(*. e 2 a ,« a ) h2 <h(t,&u b ) Vi>0. (27) 

Then, defining K := K\ x K2 and letting ^ denote the corresponding partial order, implication ((2 
reads: 
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>- 
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vt > 0. 



(28) 



The proof for arbitrary iV follows by induction. 



5 Static Input/State and Input/Output Characteristics 

A notion of "Cauchy gain" was introduced in p?| to quantify amplification of signals in a manner 
useful for biological applications. For monotone dynamical systems satisfying an additional property, 
it is possible to obtain tight estimates of Cauchy gains. This is achieved by showing that the 
output values y(t) corresponding to an input u(-) are always "sandwiched" in between the outputs 
corresponding to two constant inputs which bound the range of u(-). This additional property 
motivated our looking at monotone systems to start with; we now start discussion of that topic. 

Definition 5.1 We say that a controlled dynamical system (|l|) is endowed with the static Input/State 
characteristic 

k x {-) :U^X 

if for each constant input u(t) =u there exists a (necessarily unique) globally asymptotically stable 
equilibrium k x {u). For systems with an output map y = h(x), we also define the static Input/Output 
characteristic as k y (u) :— h(k x (u)), provided that an Input/State characteristic exists and that h is 
continuous. □ 

The paper |2i| (see also citemuratori-rinaldi for linear systems) provides very useful results which 
can be used to show the existence of I/S characteristics, for cooperative systems with scalar inputs 
and whose state space is the positive orthant, and in particular to the study of the question of when 
k x (u) is strictly positive. 

Remark 5.2 Observe that, if the system (Q) is monotone and it admits a static Input /State charac- 
teristic k x , then k x must be nondecreasing with respect to the orders in question: u >; v in U implies 
k x (u) h k x (v). Indeed, given any initial state £, monotonicity says that <fi(t,£,u) >z <fi(t,£,v) for all 
t, where u(t) = u and v(t) = v. Taking limits as t — > 00 gives the desired conclusion. □ 
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Remark 5.3 (Continuity of k x ) Suppose that for a system ([j]) there is a map k x : U — > X with the 
property that k x (u) is the unique steady state of the system x = f(x,u) (constant input u = u). When 
k x (u) is a globally asymptotically stable state for x — f(x,u), as is the case for I/S characteristics, 
it follows that the function k x must be continuous, see Proposition |5.7| below. However, continuity 
is always true provided only that k x be locally bounded, i.e. that k x (V) is a bounded set whenever 
V C U is compact. This is because k x has a closed graph, since k x (u) = x means that f(x,u) = 0, 
and any locally bounded map with a closed graph (in finite-dimensional spaces) must be continuous. 
(Proof: suppose that Ui — > u, and consider the sequence x~i = k x (v,i); by local boundedness, it is only 
necessary to prove that every limit point of this sequence equals k x (u). So suppose that x^ — > x'; 
then (ibijjXij) — > (u, x'), so by the closedness of the graph of k x we know that (u, x') belongs to its 
graph, and thus X — clS desired.) Therefore, local boundedness, and hence continuity of k x , would 
follow if one knows that k x is monotone, so that k([a,b}) is always bounded, even if the stability 
condition does not hold, at least if the order is "reasonable" enough, as in the next definition. Note 
that k y is continuous whenever k x is, since the output map h has been assumed to be continuous. □ 

Under weak assumptions, existence of a static Input/State characteristic implies that the system 
behaves well with respect to arbitrary bounded inputs as well as inputs that converge to some limit. 
For convenience in stating results along those lines, we introduce the following terminology. 

Definition 5.4 The order on X is bounded if the following two properties hold: 

1. For each bounded subset SCI, there exist two elements a, b G B such that S C [a, 6] = {x G 
X : a <x <b}. 

2. For each a, b G B, the set [a, b] is bounded. □ 

Remark 5.5 Boundedness is a very mild assumption. In general, Property 1 holds if (and only 
if) if has a nonempty interior, and Property 2 is a consequence of Kf] —if = {0}. To prove the 
first claim, suppose given a bounded set SCI, and take any element £o G intif. Now pick any 
e > such that the function ct:B^B:£H^££ + £ maps S[j — S into the interior of if (e.g., 
pick e = £o/c, if the eo-ball around £o is included in if and if each element of S[j —S has norm at 
most c). Then e£ y — £ and £o h e£ f° r ah £ € S, which means that S C [—£o/e,£o/e\. Conversely, 
suppose that Property 1 holds. Since X has nonempty interior, there exist e > and £ q £ X so that 
S := eB + £ Q X, where B is the open unit ball in B. Suppose that there would be some b such 
that b >z £ for all £ £ S. This implies that eB + r] C K, where rj := b — £o- Since eB + r\ is an open 
set, this means that K has a nonempty interior. 

Next we show that the property K f] —K = {0} implies that [a, b] is a bounded set, for any a, b. 
Assume by contradiction that a sequence x m 6 [a, 6] exists such that x m — > +oo as m — > +oo. 
Note that a; TO — a and 6 — x m both belong to if for all m. Using compactness of the unit sphere, 
it is possible to take a subsequence x mk so that the sequences 6fe := (6 — i m J/ |6 — x mjt | and :— 
(x mk — a)/ \a — x nik | both have limits as k — » +oo. Since if is a cone, bk € K and dfe S if for each 
so that closedness of if yields limfc bk := b G K and limfe := a G if. Moreover, by continuity 
of norms |-|, |&J = |a| = 1. A simple calculation exploiting the fact that \x mk \ — * +oo allows us to 
conclude that b + a = 0. Then, the property if D —if = {0} implies a = b = 0, contradicting the fact 
that \a\ = 1. □ 

Proposition 5.6 Consider a monotone system ([!]) which is endowed with a static Input/State char- 
acteristic, and suppose that the order on the state space X is bounded. Pick any input u all whose 
values u(t) lie in some interval [c, d] C U. (For example, it could be any bounded input, if if is an 
orthant in R n , or more generally if the order in U is bounded.) Let x{t) = <fr(t, £, it) be any trajectory 
of the system corresponding to this control. Then {x(t),t > 0} is a bounded subset of X. 

Proof. Let X\{t) — cj>(t,£,d), so x\{t) — > k x {d) as t — > cxd and, in particular, a^i(-) is bounded; so 
(bounded order), there is some b G B such that x\{t) < b for all t > 0. By monotonicity, 

z(i) = £, u) ^ f,d)=ii(^6 
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for all t > OA similar argument using the lower bound conn shows that there is some a G B such 
that a ^ x(t) for all t. Thus x{t) G [a, b] for all t, which implies, again appealing to the bounded 
order hypothesis, that x(-) is bounded. I 

Certain standard facts concerning the robustness of stability will be useful. We collect the neces- 
sary results in the next statements, for easy reference. 

Proposition 5.7 If ([[]) is a monotone system which is endowed with a static Input/State character- 
istic k x , then k x is a continuous map. Moreover for each u G U, x — k x (u), the following properties 
hold: 

1. For each neighborhood P of x in X there exist a neighborhood Pq of x in X, and a neighborhood 
Qo of u in U, such that cj>(t, £, u) G P for all t > 0, all £ € Po, and all inputs u such that G Qo 
for all t > 0. 

2. If in addition the order on the state space X is bounded, then, for each input u all whose values 
u(t) lie in some interval [c, d] C U and with the property that u(t) — > u, and all initial states 
£ G X, necessarily x(t) = </>(i, £, u) — » x as i — > oo. 



Proof. Consider any trajectory x(t) = £,u) as in Property 2. By Proposition 5.6, we know that 
there is some compact CCl such that x(t) G C for all t > 0. Since X is closed, we may assume that 
CCI. We are therefore in the following situation: the autonomous system x — f{x,u) admits x as 
a globally asymptotically stable equilibrium (with respect to the state space X) and the trajectory 
x(-) remains in a compact subset of the domain of attraction (of x = f(x, u) seen as a system on an 
open subset of B which contains X). The "converging input converging state" property then holds 
for this trajectory; see [|{| or the "local ISS" results in |2{| (the paper |25| was written for globally 
asymptotically stable systems in R n , and for U Euclidean, but these hypotheses were not used, and 
the result holds under the conditions that apply in this paper; see p8|, Theorem 1, for details). 

Property 1 is a consequence of the same results (once again, see p8fl, Theorem 1, for details). 

The continuity of k x is a consequence of Property 1. As discussed in Remark |5.3| , we only need 
to show that k x is locally bounded, for which it is enough to show that for each u there is some 
neighborhood Qo of u and some compact subset P of X such that k x (n) £ P for all // G Qq. Pick 
any u, and any compact neighborhood P of x — k x (u). By Property 1, there exist a neighborhood 
Pq of x in X, and a neighborhood Qo of u in U, such that (f>(t, £,« M ) G P for all t > whenever 
£ G Pq and u^(t) = [i with [i G Qo- In particular, this implies that k x (fi) — lim^oo <j)(t,x^u^) G P. 
which is as required. I 

Corollary 5.8 Suppose that the system x = f(x, u) with output y = h(x) is monotone and has static 
Input/State and Input/Output characteristics k x , k y , and that the system i = g(z,y) (with input 
value space equal to the output value space of the first system) has a static Input/State characteristic 
k z , it is monotone, and the order on its state space Z is bounded. Assume that the order on outputs 
y is such that whenever y is bounded, there are c, d such that y(t) G [c, d] for all t > (for instance, 
K might be an orthant). Then the cascade system 

x = f(x,u), y = h(x) 
z = 9{z, y) 

is a monotone system which admits the static Input/State characteristic k{u) — (k x (u), k z (k y {u))). 

Proof. Pick any u. We must show that k(u) is a globally asymptotically stable equilibrium of the 
cascade. Pick any initial state (£,C) of the composite system, and let x(t) — (f> x (t^,u) (input 
constantly equal to u), y{t) = h(x(t)), and z(t) = (f) z (t,(,y)- Notice that x(t) — > x and y(t) — 
h(x(t)) —^y — k y (u), so viewing y as an input to the second system and using Property 2 in 
Proposition |5.7|, we have that z(t) — > z — k z (k y (u)). This establishes attractivity. To show stability, 



pick any neighborhoods P x and P z of x and z respectively. By Property 1 in Proposition 5.7, there 
are neighborhoods Po and Qo such that £ G Po and y{t) G Qo for all t > imply (j> z (t, £, y) G P z for 
all t > 0. Consider Pi := P x f] /i _1 (Qo), which is a neighborhood of x, and pick any neighborhood 
P2 of x with the property that <p(t, £, u) G Pi for all £ G P2 and all t > (stability of the equilibrium 
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x). Then, for all (£, £) € Pa x P , = <j> x {t,£,u) G Pi (in particular, x(t) 6 P x ) for all i > 0, so 
y(t) = h{x{t)) € Qo, and hence also z(t) = <j> g {t, C, y) S Q z for all i > 0. I 

In analogy to what usually done for autonomous dynamical systems, we define the f2-limit set 
of any function a : [0, oo) — » A, where A is a topological space (we will apply this to state-space 
solutions and to outputs) as follows: 

Cl[a] := {a G A \ 3 tk — > +oo s.t. a{tk) —> a as k — » +00} 

(in general, this set may be empty). For inputs u € Woo, we also introduce these two sets: 

C<[u] :— {/i E U I 3 tk — > +00 and /ifc — > /i as — > +00, /ife € such that ^ /ife Vt > tk} 

and 

£>[u] := {/i G £Y I 3 tfe — > +00 and /ife — > /i as fc — > +00, //& £ such that /ife ^ Vt > tk} ■ 

These notations are motivated by the following special case. 

Suppose that we consider a SISO (single-input single-output) system, by which we mean a system 
for which = R and My = R, taken with the usual orders. Given any scalar bounded input «(•), we 
denote u- m { := liminf t _ > _|_ 0o u{t) and u sup := limsup t ^ +oc u{t). Then, u- m { G £<[u] and w sup G £>[u], 
as follows by definition of lim inf and lim sup. Similarly, both liminf t ^ +00 y(t) and limsup t ^ +00 y(t) 
belong to £l[y], for any output y. 

Proposition 5.9 Consider a monotone system ([j]), with static I/S and I/O characteristics k x and 
k y . Then, for each initial condition £ and each input u, the solution x(t) = cf>(t,^,u) and the 
corresponding output y(t) = h(x(t)) satisfy: 

k x (C<[u}) < a[x] 1 k x (C>[u}) 

and 

k y (C<[u}) d C%] d k y (C>[u}) . 

Proof. Pick any £, u, and the corresponding x(-) and y(-), and any element /i G £<[u]. Let tk — > +00, 
/ife — > /i, with all /ife G U 1 and it(i) ^ /ife for all i > ife. By monotonicity of the system, for t > tk we 
have: 

it) = x(t - ife,x(tfe,£,u),w) ^ cc(t - t k ,x(t k ,C,u),^k) ■ (29) 
In particular, if a;(s^) — » £ f° r some sequence S£ — ► 00, it follows that 

C >r lim x(si - tk,x(tk,£,u),fjik) = k x (/Jk) ■ 

Next, taking limits as k — > 00, and using continuity of k x , this proves that £ >; k x {ii). This property 
holds for every elements £ G f2[x] and /x G £<[u], so we have shown that k x (C<[u\) < ft[x]. The 
remaining inequalities are all proved in an entirely analogous fashion. I 

In particular we have: 

Proposition 5.10 Consider a monotone SISO system (|]), with static I/S and I/O characteristics 
k x {-) and k y (-). Then, the I/S and I/O characteristics are nondecreasing, and for each initial condition 
£ and each bounded input u(-), the following holds: 

k y (u in {) < liminf y(t,£,u) < limsup y(t, £, u) < k y (u sup ) . (30) 

If, instead, outputs are ordered by >, then the I/O static characteristic is nonincreasing, and for 
each initial condition £ and each bounded input u(-), the following inequality holds: 

k y (u sup ) < liminf y(t,£,u) < limsupy(i,£,u) < k y (u inl ) . (31) 
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Proof. The proof of the first statement is immediate from Proposition |5.9| and the properties: u- m i £ 
C<[u\, ti sup € £>[«], liminft^+oo y(t) £ f2[y] , and limsup t ^ +oc y(t) £ Cl[y], and the second statement 
is proved in a similar fashion. I 



Remark 5.11 It is an immediate consequence of Proposition 5.10 that, if a monotone system admits 
a static I/O characteristic k, and if there is a class-ZCoo function 7 such that \k(u) — fc(^)| < 7(|u — v\) 
for all it, v (for instance, if k is Lipschitz with constant p one may pick as 7 the linear function 
7(7') = pr) then the system has a Cauchy gain (in the sense of (27) ) 7 on bounded inputs. □ 



6 Feedback Interconnections of Monotone Systems 

In this section, we study the stability of SISO monotone dynamical systems connected in feedback 
as in Fig. ^| Observe that such interconnections need not be monotone. 
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Figure 2: Systems in feedback 



Based on Proposition 5.10, one of our main results will be the formulation of a small-gain theorem 
for the feedback interconnection of a system with monotonically increasing I/O static gain (positive 
path) and a system with monotonically decreasing I/O gain (negative path). 

Theorem 2 Consider the following interconnection of two SISO dynamical systems 

x = f x {x,w), y = h x (x) , 32 > 
z = fe{z,y), w = h z (z) 

with IA X — y z and U z — y x . Suppose that: 

1. the first system is monotone when its input w as well as output y are ordered according to the 
standard order < of the real axis; 

2. the second system is monotone when its input y is ordered according to < and its output w is 
ordered by >; 

3. the respective static I/S characteristics k x {-) and k z (-) exist (thus, the static I/O characteris- 
tics ^y(') and k w (■) exist too and are respectively monotonically increasing and monotonically 
decreasing); and 

4-- every solution of the closed-loop system is bounded. 

Then, system ( pl[ ) has a globally attractive equilibrium provided that the following scalar discrete time 
dynamical system, evolving in U x : 

u k+1 = (k w o k y ) (u fc ) (33) 
has a unique globally attractive equilibrium u. 

For a graphical interpretation of condition ( p3| ) see Fig. [| 

Proof. Equilibria of ( B2p are in one to one correspondence with solutions of k w (k y (u)) = u, viz. 
equilibria of (33). Thus, existence and uniqueness of the equilibrium follows from the GAS assumption 
on @. 

We need to show that such an equilibrium is globally attractive. Let £ £ R™ x x R™ z be an 
arbitrary initial condition and let y+ := limsup t ^ +oc y{t, £) and y_ := liminft^+oo y(t, £). Then, 
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Figure 3: I/O static characteristics in the (w, y) plane: negative feedback 



w + := limsup* >+00 w(t, £) and u>_ := liminf t _^ +oc w(t, £) satisfy by virtue of the second part of 
Proposition |5.10 , applied to the z-subsystem: 



k z (y+)<w-<w+<k z (y-). (34) 

An analogous argument, applied to the x-subsytem, yields: k x (w_) < x_ < x + < k x (w + ) and by 
combining this with the inequalities for w + and w_we end up with: 

k x {k z {y+)) <y- <y+ < k x {k z {y-)) . 

By induction we have, after an even number In of iterations of the above argument: 

(k x o k z ) 2n (y-) <y-<y+< (k x o k z ) 2n (y + ) . 

By letting n — » +00 and exploiting global attractivity of (|33| ) we have y_ = y + . Equation (^J) yields 
W- = w + . Thus there exists u, such that: 

u = lim t ^ +00 y(t,0 C 35 n 
k z (u) = ]im t ^ +00 w(t, ^) . 

Let z e be the (globally asymptotically stable) equilibrium (for the z-subsystem) corresponding to the 
constant input y(t) = u and x e the equilibrium for the ir-subsystem relative to the input w(t) = k z (u). 
Clearly r\ := [x e , z e ] is the unique equilibrium of (p^). The fact that [x(t, f), z(i,£)] — > now follows 
from Proposition |5. 



Remark 6.1 We remark that traditional small-gain theorems, see for instance |lq| , also provide 
sufficient conditions for global existence and boundedness of solutions. In this respect it is of interest 
to notice that, for monotone systems, boundedness of trajectories follows at once provided that at 
least one of the interconnected systems has a uniformly bounded output map (this is always the case 
for instance if the state space of the corresponding system is compact). However, when both output 
maps are unbounded, boundedness of trajectories needs to be proved with different techniques. The 
following Proposition addresses this issue and provides additional conditions which together with the 
small-gain condition allow to conclude boundedness of trajectories. □ 

We say that the I/S characteristic k x (-) is unbounded (relative to X) if for all £ £ X there exist 
Mi, i«2 £ U so that k x (u\) h £, h k x (u-2). 

Lemma 6.2 Suppose that the system ([!]) is endowed with an unbounded I/S static characteristic 
and that inputs are scalar (B^ = K with the usual order). Then, for any £ £ X there exists £ G X 
so that for any input u: 

<f>(t, £, u) ^ max \ £, k x f sup u(t) ) > Vi>0. (36) 
An analogous property holds with ^ replaced by y and sup's replaced by inf's. 
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We remark that x < max{yi, 2/2} is just a short-hand notation for x < y\ or x ■< 2/2 • 

Proof. Let £ 6 X be arbitrary. As fc^ is unbounded there exists u such that £ < k x (u) := £. Pick any 
input m and any to > 0, and let /1 := sup Te m to i u(r). There are two possibilities: /i < u or /.t > w. 
By monotonicity with respect to initial conditions and inputs, the first case yields: 

0(to,e.«)=<0(«o,e,fi) = e. (37) 

So we assume from now on that fi > u. We introduce the input U defined as follows: U(t) :— fi for 
all t < to, and U(t) = u(t) for t > to- Notice that U >z u, and also that (j)(to,k x (fi),U) — k x (fi), 
because the state k x {p) is by definition an equilibrium of x = f(x./j,) and U(t) = fi on the interval 
[0, to]- We conclude that 

4>(t ,Z,u)^(t>{to,k x (u),U)) = k x (iJ,) (38) 



and ( p6[ ) follows combining ( |37| ) and (38). The statement for >; is proved in the same manner. I 

Proposition 6.3 Consider the feedback interconnection of two SISO monotone dynamical systems 
as in (32), and assume that the orders in both state-spaces are bounded. Assume that the systems 
are endowed with unbounded I/S static characteristics k x (-) and k z (-) respectively. If the small gain 
condition of Theorem is satisfied then solutions exist for all positive times, and are bounded. 

Clearly, the above result allows to apply Theorem also to classes of monotone systems for which 
boundedness of trajectories is not apriori known. 

Proof. We show first that solutions are upper-bounded. A symmetric argument can be used for 
determining a lower bound. Let £,£ be arbitrary initial conditions for the x and z subsystems. 
Correspondingly solutions are maximally defined over some interval [0, T). Let t be arbitrary in 
[0, T). By Lemma 1x2, equation ( |36| ) holds, for each of the systems. Moreover, composing (|36| ) (and 
its counter-part for lower-bounds) with the output map yields, for suitable constants y, w, y,w which 
only depend upon £, £. 

y(t,£,w) < max< y,k y I max w(t) I > (39) 
I \ re lM / J 

w(t,(,y) < max min y(r) I > (40) 

I \r£[0,t] J I 



y(t,£,,w) > min \ y, k y ( mrn^ w(f) ) } (41) 



w(t,(,y) > min \ w, k w ( max y(r) ) \ . (42) 



Substituting equation ( fto| ) into ( ]3&] ) gives: 



y(t, t w) < max | y, k y (w),k y o k w \ min^ y(r)J j . (43) 
Analogously, substitution of (|4l]) into (^3|) yields (using that k y o k w is & nonincreasing function): 



y(t,£, w) < max <^ y, k y (w), k y o k w (y), k y o k w o k y ( min w(t))>. (44) 

— T£[0,t] 



Finally equation (|42j) into ( |44[ ) yields: 

y(t, f , w) < max ja, p o p ^max j/(t)J | , (45) 

where we are denoting p :— k y o k w and 

a = a(£, C) := max{y, k y (w), k y o k w (y), k y o k w o k y (w)} . 
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Let y e be the output value of the rr-subsystem, corresponding to the unique equilibrium of the 
feedback interconnection (|32|). 

Notice that attractivity of ( |33| ) implies attractivity of y(t + 1) = k y o k w (y(t)) := p(y(t)) and a 



fortriori of 

We claim as follows: 



y(t+l) = pop(y(t)). (46) 



v > Ve p ° p{y) < y- (47) 

By attractivity, there exists some y\ > y e such that p o ,0(2/1) — y\ < (otherwise all trajectories 
of (46) starting from y > y e would be monotonically increasing, which is absurd). Now, assume 
by contradiction that there exists also some y2 > y e such that p o p(y 2 ) — 2/2 > 0. Then, as p 
is a continuous function, there would exist an yo £ (2/1,2/2) (or in (2/2,2/1) if J/2 < Vx) such that 
P p(j/o) = 2/o- This clearly violates attractivity (at y e ) of (^6|), since 2/0 is an equilibrium point. 
So @ is proved. 

Let M := max Te [ ,t] y{r), so M = y(ra) for some ro £ [0,t]. Therefore ( ]45| ) at i = tq says 
that y(ro) < max{«, p o p(2/( r o))}j and ( |47| ) applied at y = 2/( T o) gives that 2/(70) < max{a, y e } (by 
considering separately the cases J/(ro) > j/ e and 2/(to) < y e ). As y(t) < y(ro), we conclude that 
j/(t) < max{a,2/ e }- This shows that y is upper bounded by a function which depends only on the 
initial states of the closed-loop system. Analogous arguments can be used in order to show that y 
is lower bounded, and by symmetry the same applies to w. Thus, over the interval [0, T) the x and z 
subsystems are fed by bounded inputs and by monotonicity (together with the existence of I/S static 



characteristics) this implies, by Proposition 5.6, that T = +00 and that trajectories are uniformly 
bounded. I 



7 An Application 

A large variety of eukaryotic cell signal transduction processes employ "Mitogen-activated protein 
kinase (MAPK) cascades," which play a role in some of the most fundamental processes of life (cell 
proliferation and growth, responses to hormones, etc). A MAPK cascade is a cascade connection of 
three SISO systems, each of which is (after restricting to stoichiometrically conserved subsets) either 
a one- or a two-dimensional system, see 0. We will show here that the two-dimensional case 
gives rise to monotone systems which admit static I/O characteristics. (The same holds for the much 
easier one-dimensional follows from the results in p7|.) 

After nondimensionalization, the basic system to be studied is a system as in (|i"3|), where the 
functions 9i are of the type 

1 + bjT 

for various positive constants i. It follows from Proposition |3.5| that our systems (with output y) are 
monotone, and therefore every MAPK cascade is monotone. 

We claim, further, that each such system has a static I/O characteristic. It will follow, by basic 
properties of cascades of stable systems, that the cascades have the same property. Thus, the complete 
theory developed in this paper, including small gain theorems, can be applied to MAPK cascades. 

Proposition 7.1 For any system of the type (|l3|), and each constant input u, there exists a unique 
globally asymptotically stable equilibrium inside A. 

Proof. As the set A is positively invariant, the Brower Fixed-Point Theorem ensures existence of an 
equilibrium. In order to show that this equilibrium is unique, we consider the Jacobian of /: 



V/ 

Notice that: 



-D9i(x) -D6 2 (l-x -y) -D6 2 (l-x-y) 

-D6 3 (l-x-y) -D9i{y)-D0 z (l-x-v) 



(48) 



tr(V/) = -D9 1 (x)-D9 2 (l-x-y)-De 4 (y)-D9 3 (l-x-y)<0, Vx,j/eA 
det(V/) = D9 1 (x)D9 4 (y) + D0 1 (x)D9 3 (l - x - y) + D9 2 (l - x - y)D9 4 (y) > 0, Va^yeA 
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The Jacobian Theorem by R. Fessler (sec |nj) ensures injectivity of / whenever V/ is injective 
globally over A (as it is the case, since det ^ 0). Therefore the equilibrium is unique. As V/ is 
Hurwitz it is also locally asymptotically stable. 

In order to conclude global asymptotic stability, we only need by Poincare-Bendixson to rule out 
the possibility of limit cycles. Bendixson's Criterion shows, indeed, that no periodic orbits can exist 
in A, since div(/) < 0. I 

Fig. ^ shows the phase plane of the system (the diagonal line indicates the boundary of the 
triangular region of interest), when coefficients have been chosen so that the equations are: 



x = -1.0- 



1 + x 



3-x-y 



y = 



2-x-y 



-2 




Figure 4: Direction field for example 



8 Relations to Positivity 

In this section we investigate the relationship between the notions of cooperative and positive systems. 
Positive linear systems (in continuous as well as discrete time) have attracted much attention in the 
control literature, see for instance g, [| |l|, |2^, [u| . We will say that a finite dimensional linear 
system, possibly time- varying, 

x — A(t)x + B(t)u (49) 

(where the entries of the n x n matrix A and the n x m matrix B are Lebesgue measurable locally 
essentially bounded functions of time) is positive if the positive orthant is forward invariant for 
positive input signals; in other words, for any £ y and any u(t) y (y denotes here the partial 
orders induced by the positive orthants), and any to 6 K it holds that <p(t, to,£,u) y for all t > to- 
Let say that ( p9[ ) is a Metzler system if A(t) is a Metzler matrix, i.e., Ay(t) > for all i =/= j, 
and Bij{t) > for all for almost all t > 0. It is well known for time-invariant systems (A and 
B constant), see for instance [^9|, Chapter 6, or || for a recent reference, that a system is positive 
if and only if it is a Metzler system. This also holds for the general case, and we provide the proof 
here for completeness. For simplicity in the proof, and because we only need this case, we make a 
continuity assumption in one of the implications. 

Lemma 8.1 If ( |49] ) is a Metzler system then it is positive. Conversely, if ( ^9| ) is positive and ^4(-) 
and B(-) are continuous, then ( |49| ) is a Metzler system. 

Proof. Let us prove sufficiency first. Consider first any trajectory x(-) with x(s) 3> 0, any fixed 
T > s, and any input u(-) so that u(t) > for all t > s. We need to prove that x(T) y 0. 
Since A(t) is essentially bounded (over any bounded time-interval) and Metzler, there is an r > 
such that rl + A(t) > for almost all t G [s, T], where ">" is meant elementwise. Consider 
z(t) := exp(r(t — s))x(t) and v(t) := exp(r(i — s))u(t), and note that z(s) — x(s) » and v(t) > 
for all t > s. We claim that z(t) y for all t € [s, T]. Let r > s be the infimum of the set 
of t's such that z(t) >t and assume, by contradiction, r < +oo. By continuity of trajectories, 
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z(t) t 0. Moreover z(r) = z(s) + f s z{t)dt = z{s) + f s {rl + A(t))z(t) + B(t)v(t) dt t z(s) > 0, 
and therefore there exists an interval [t,t + e] such that z(t) y for all t £ [r, r + e]. But this 
is a contradiction, unless t = +oo as claimed. By continuous dependence with respect to initial 
conditions, and closedness of the positive orthant, the result carries over to any initial condition 
x(s) h 0. 

For the converse implication, denote with s) the fundamental solution associated to A(t) (viz. 
d^/dt = A(t)$, and $(s,s) = I). Using u = we know that <£(i,s) > whenever t > s (">" is 
meant here elementwise) . Therefore also s) — 7]jj > for all i ^ j. Since 



At \ 9 



$(t, r) = lim v ; 



t->o i 



for all r, it follows that ^(t)^ > for all i ^ j. Consider a solution with x(s) = 0, u constant > 0, 
for t > s. Since x(t) >z 0, also (l/(t — s))x(t) >r 0, and therefore, taking limits as t \ 0, x(s) >z 
(the derivative exists by the continuity assumption). But x(s) — A(s)x(s) + B(s)u, and x(s) = 0, so 
B(s)u >z for all such u, i.e. B(s) ^0. I 



Thus, by virtue of Theorem 3.3, a time-invariant linear system is cooperative if and only if it is 
positive. The result is a system-theoretic analog of the fact that a diffcrentiable scalar real function 
is monotonically increasing if and only if its derivative is always nonnegative. 

We next provide a result which says, in essence, that cooperativity is the same as "incremental 
positivity" (see 0, (3(| for other notions of incrementality). This fact, for the special case of linear 
systems can be seen as a direct consequence of linearity, using the fact that the relation £i >z £2 is 
the same as £1 — £2 t and similarly for inputs. 

Definition 8.2 We say that a system (|l|) is incrementally positive (or "variationally positive") if, 
for every solution x(t) = <fr(t, £, u) of (|l|), the linearized system 

z = A(t)z + B(t)v (50) 

where A(t) = ^(x(t),u(t)) and B(t) = |^(a;(t), u(t)), is a positive system. □ 

Proposition 8.3 Suppose that Mu = M m , hi satisfies an approximability property, and that both 
V and W = intlA are order-convex. Let f(x,u) be continuously differentiable. Then system ([!]) is 
cooperative if and only if it is incrementally positive. 

Proof. Under the given hypotheses, a system is cooperative iff ^-(x, u) is a Metzler matrix, and every 
entry of ^(x,u) is nonnegative, for all x £ X and all u G U, cf. Proposition |3.3| . Therefore, by 
the criterion for positivity of linear time-varying systems, this implies that ( |50| ) is a positive linear 
time- varying system along any trajectory of ([!]). 

Conversely, pick an arbitrary £ in X and any input of the form u(-) — u G IA. Suppose that ( |50| ) is 
a positive linear time- varying system along the trajectory x{t) — x(t, £, u) (this system has continuous 
matrices A and B because u is constant). Then, by the positivity criterion of linear time- varying 
systems, for all t > we have ^(x(t),u) is Metzler and ^(x(t),u) >z 0. Finally, evaluating the 
Jacobian at t — yields that §j(£,«) is Metzler and w) is non nega tive. Since £ and u were 



arbitrary, we have the condition for cooperativity given in Proposition 3.3 



Remark 8.4 Looking at cooperativity as a notion of "incremental positivity" one can provide an 
alternative proof of the infinitesimal condition for cooperativity, based on the positivity of the varia- 
tional equation. Indeed, assume that each system ( |50| ) is a positive linear time- varying system, along 
trajectories of (|l]). Pick arbitrary initial conditions £1 >z £2 G X and inputs u\ > U2- Let $(/i) be 
defined as: 

:= <£(t, 6 + ~ 6), «2 + h(ui - ua)). 
By virtue of Theorem 1 in we have 

0(t,Ci 1 ui)-^(t,&,« 2 )=4(l)-*(O)= / &(h)dh= I z h {t,^-i 2 ,u 1 -u 2 )dh (51) 



n 
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where Zh denotes the solution of ( |50|) when §{■(£, u) and ^(x,u) are evaluated along (p(t, £2 + MCi — 
£2)7 U2 + h(ui — U2)). Therefore, by positivity, exploiting ( pl| ) and monotonicity of the integral we 
have — </!>(£, £2, 1*2) h 0, as claimed. □ 

We remark that monotonicity with respect to other orthants correspond to generalized positivity 



properties for linearizations, as should be clear by Corollary 3.4 



Appendix: A Lemma on Invariance 

We present here a characterization of invariance of relatively closed sets, under differential inclusions. 
The result is a simple adaptation of a well-known condition, and is expressed in terms of appropriate 
tangent cones. 



A.l Differential inclusions 

We let V be an open subset of some Euclidean space R ra and consider set-valued mappings F defined 
on V: these are mappings which assign some subset F(x) C R™ to each x G V. Associated to such 
mappings F are differential inclusions 

x G F{x) (52) 

and one says that a function x : [0, T] — > V is a solution of ( p2| ) if x is an absolutely continuous 
function with the property that x(t) G F(x(t)) for almost all t G [0, T]. A set- valued mapping F is 
compact-valued if F(£) is a compact set, for each £ G V. 

A set-valued mapping _F is said to be locally Lipschitz if the following property holds: for each 
compact subset C C V there is some constant fc such that 

f(0 c f(0 + ft |£-C|£ vccgc 

where £? denotes the unit ball in 1™. In other words, for any two elements £, £ of C, and for 
every / G F(£), there must exist some /' G F(() such that |/ — /' < fc |£ — £1- (We use |x| to 
denote Euclidean norm in R™.) Note that when F(x) = {f(x)} is single- valued, this is the usual 
dehnition of a locally Lipschitz function. More generally, suppose that f(x,u) is locally Lipschitz in 
x G V, locally uniformly on u, and pick any compact subset D of the input set U; then Fd(x) = 
{/(x,m),w G D} is locally Lipschitz. Indeed, given any compact C C V, we may pick a constant A; 
such that u) — /(C, zt)| < fc |C — CI f° r au Cj C 6 C an d all u G D (local Lipschitz condition on /), 
and thus, given / = /(£, u), we verify the definition by picking /' := /(C, u) with the same u. Also, 
i^D is compact-valued, since each set /(£, -D) is compact, as / is continuous. 

We say that the set-valued mapping F defined on V is locally bounded if for each compact subset 
C C V there is some constant fc such that 

F(0 C kB V£gC. 

When F has the form Fd as above, it is locally bounded, since Fd(£) C /(C x D), and, / being 
continuous, the latter set is compact. 



A. 2 Invariance 

Let S be a (nonempty) closed subset relative to V, that is, S = Sf] V for some closed subset S of 
R". We wish to characterize the property that solutions which start in the set S must remain there: 



Definition A. 5 The subset S is strongly invariant under the differential inclusion (52) if the follow- 
ing property holds: for every solution x : [0, T] — > V which has the property that x(0) G S, it must 
be the case that x(t) G S for all t G [0, T]. □ 



For any C G 5, the tangent cone to iS at £ was introduced in Definition 3.2. Note that a vector v 
belongs to 7^5 if and only if there is a sequence of elements v% G V, Uj — > v and a sequence £ j \, 
such that x + tiVi G 5 for all i. This is a standard definition, see e.g. 0, Section 2.7, and the object so 
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defined is usually called the Bouligand or contingent tangent cone (to differentiate it from other types 
of tangent cones). The set T^S is indeed a cone (v G T^S and A £ K>o imply A v G T^S: just use UjX 
if A > 0, and & = £ if A = 0) and is always closed (if Vj — » v and (1/Uj) (£y — £) — + Vj with ^ -* £ and 

£y \ as i — > oo, then one may pick a sequence {i(j)} such that |(1/^(j)j) (Ci(j)j — ^) — | < l/j 
and \ as j — » oo; this sequence satisfies that — £) — » f )• Further, 7^5 = M n 

when x is in the interior of S relative to V (so only boundary points are of interest). 

Theorem 3 Suppose that F is a locally Lipschitz, compact-valued, and locally bounded set-valued 
mapping on the open subset V C M. n , and S is a closed subset ofV. Then, the following two properties 
are equivalent: 

1. S is strongly invariant under F . 

2- F(£) C T e S for every 

Just for purposes of the proof, let us say that a set-valued mapping F is "nice" if F is defined on all 
of R™ and it satisfies the following properties: F is locally Lipschitz, compact- valued, convex-valued, 
and globally bounded (F(£) C kB for all £ G R n , for some k). Theorem 4.3.8 in || establishes that 
Properties 1 and 2 in the statement of Theorem || are equivalent, and are also equivalent to: 

F(0CcoT e 5 for every £ G <S (53) 

( "co" indicates closed convex hull) provided that S is a closed subset of W 1 and F is nice (a weaker 
linear growth condition can be replaced for global boundedness, c.f. the "standing hypotheses" in 
Section 4.1.2 of ||). We will reduce to this case using the following observation. 

Lemma A. 6 Suppose that F is a locally Lipschitz, compact-valued, and locally bounded set-valued 
mapping on the open subset V C R™, and S is a closed subset of V. Let M be any given compact 
subset of V. Then, there exist a nice set- valued F and a closed subset S' of W 1 such that the following 
properties hold: 

F{0 C %) V(eAf (54) 
Mf]S C 5' C 5 (55) 

V£ G 5', cither F(f) = {0} or = T e S' (56) 

T^S^T^S' V(GM. (57) 

and 

5 strongly invariant under F ^ S' strongly invariant under F (58) 

Proof. Consider the convexification F of F; this is the set-valued function on V which is obtained by 
taking the convex hull of the sets F(£), i.e. F(£) := coF(£) for each ( £ V. It is an easy exercise 
to verify that if F is compact- valued, locally Lipschitz, and locally bounded, then F also has these 
properties. 

Clearly, if S is strongly invariant under F then it is also strongly invariant under F, because every 
solution of x G F(x) must also be a solution of x G F(x). Conversely, suppose that S is strongly 
invariant under F, and consider any solution x : [0, T] — > V of x G F(x) which has the property 
that x(0) G S. The Filippov-Wazewski Relaxation Theorem (see e.g. ||, pl| ) provides a sequence of 
solutions Xk, k = 1, 2, . . ., of x G F(x) on the interval [0,T], with the property that Xfc(£) — > x(i) 
uniformly on t £ [0, T] and also cCfe(O) = a;(0) G 5 for all fc. Since S is strongly invariant under F, it 
follows that G S for all fc and t G [0,F], and taking the limit as k — > oo this implies that also 

x(t) G 5 for all t. In summary, invariance under F or F are equivalent, for closed sets. 

Let N be a compact subset of V which contains M in its interior int N and pick any smooth 
function <p : 1" — > R>o with support equal to N (that is, (yj(£) = if a; int iV and </j(£) > on 
intiV) and such that (/?(£) = 1 on the set M. Now consider the new differential inclusion defined on 
all of M™ given by F(f ) := v?(£)F(£) if £ G iV and equal to {0} outside iV. Since F is locally Lipschitz 
and locally bounded, it follows by a standard argument that F has these same properties. Moreover, 
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F is globally bounded and it is also convex- valued and compact-valued (see e.g. [fL8| ). Thus F is 
nice, as required. 

Note that Property (||) holds, because F(£) C and y> = 1 on M. 

Let S' := Sf]N (cf. Figure |); this is a closed subset of M™ because the compact set N has a 
strictly positive distance to the complement of V. Property (|5^) holds as well, because M C N. 




Figure 5: Shaded area is set S' 



Now pick any £ £ S' . There are two cases to consider: £ is in the boundary of N or in the 
interior of N. If £ €E cW, then = {0} because y>(£) = 0. If instead £ belongs to the interior 

of AT, there is some open subset V C N such that £ 6 V. Therefore any sequence £j — > £ with all 
£i E S has, without loss of generality, & € V P| 5 C A 7 |~| 5 = S' , so also & — > £ in 5'; this proves 
that 7^5 C 7^5', and the reverse inclusion is true because S' C 5. Hence Property ( |56| ) has been 
established. 

Regarding Property (^), this follows from the discussion in the previous paragraph, since M is 
included in the interior of N. 

In order to prove the last property in the theorem, we start by remarking that if x : [0, T] — ► M. n is 
a solution of x £ F(x) with the property that x(t) belongs to the interior of TV for all t (equivalently, 
ip(x(t)) =/= for all t), then there is a reparametrization of time such that a; is a solution of x £ F(x). 
In precise terms: there is an interval [0, R], an absolutely continuous function a : [0, oo) — > [0, oo) 
such that a(0) = and a(R) — T, and a solution z : [0, R] — > K™ of z £ F(z) such that z(r) — x(a(r)) 
for all r £ [0, J?]. To see this, it is enough (chain rule, remembering that F(£) — ip(£)F(x)) for a to 
solve the initial value problem da/dr — /3(a(r)), a(0) — 0, where (5(t) = l/ip(x(t)) for t < T and 
(3(t) = (3(T) for t > T. The function <p(x(t)) is absolutely continuous, and is bounded away from 
zero for alH < T (because the solution x lies in a compact subset of the interior of the support of 
<p), so (3 is locally Lipschitz and a (unique) solution exists. Since (3 is globally bounded, the solution 
has no finite escape times. In addition, since the vector field is everywhere positive, a(r) — > oo as 
s — » oo, so there is some R such that a(R) — T. 

Now suppose that S is invariant under F. As remarked earlier, this implies that S is also invariant 
under its convexification F. 

Suppose that x : [0, T] — > R n is a solution of x — F(x) such that x(0) £ S' and x(t) is in the 
interior of A^ for all t. We find a solution z of z £ F(z) such that z(r) = x(a(r)) for all r £ [0, R] and 
z(0) = x(0) £ S' C 5 as earlier. Invariance of 5 under i 7, gives that z(r), and hence x(t), remains in 
S. Since 5' = Sf] N, we conclude that x(t) £ S' for all t £ [0, T]. 

Next, we use some ideas from the proof of Theorem 4.3.8 in S. Pick any £o S 5', and any 
u £ F(£o). Define the mapping / : M n -> M" by the following rule: for each £ £ R", /(£) is the 
unique closest point to u in F(£). As in the above citation, this map is continuous. We claim that, 
for each £ £ S' there is some 6 > and a solution of x = f(x) such that x(0) = £ and x(t) £ S' for 
all t £ [0,(5]. (Note that, in particular, this x solves x £ F(x).) If £ is on the boundary of N, then 
F(£) = {0} implies that /(£) = 0, and hence x(t) = £ is such a solution. If instead £ belongs to the 
interior of N then the previous remarks shows that x(t) £ S' for all t £ [0, S], where we pick a smaller 
d if needed in order to insure that x(t) remains in the interior of N. We conclude from the claim 
that the closed set S' is locally-in-time invariant with respect to the differential inclusion {/(#)}, 
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which satisfies the "standing hypotheses" in Chapter 4 of 0|. This inclusion is hence also "weakly 
invariant" as follows from Exercise 4.2.1 in that textbook. This in turn implies, by Theorem 4.2.10 
there, that (/(C), C) f° r an £, & S' and all C m the proximal normal set N^S' defined in that 
reference (we are using a different notation). Applied in particular at the point Co (so that /(Co) = v), 
we conclude that (v,() < for all £ € N^ S' . Since v was an arbitrary element of -F(Co), it follows 
that the upper Hamiltonian condition in part (d) of Theorem 4.3.8 in holds for the map F at the 
point Co- Since Co was itself an arbitrary point in S' , the condition holds on all of S' . Therefore <S' 
is invariant for F, as claimed. I 

A. 3 Proof of Theorem |3| 
Proof that 2^>1 

Suppose that F(£) C 7^5 for every £ G S, and pick any solution x : [0, T] — » V of i 6 F(x) with 
x(0) £ S. 

Since x(-) is continuous, there is some compact subset MCV such that x(t) £ M for all t £ [0, T\. 



We apply Lemma A. 6 to obtain F and S' . By Property (|54|), it holds that a; is also a solution of 
x £ F(x), and Property ( |55"| ) gives that x(0) belongs to the subset 5'. 

Taking convex hulls, F(x) C co 7j<S for every a; G <S. Since F is a scalar multiple of F, and co 7j<S 
is a cone (because 7^5 is a cone), it follows that F(g) C co 7^5 for every £ £ S, and so also for £ £ S' . 
By Property (|56"1), 

F(C)Cco7^S' VCgS', (59) 

since either F(C) = or T^S' = T^S (and hence their convex hulls coincide). 

In summary, Property ( |53"| ) is valid for F in place of F and 5' in place of S, and F is nice. Thus 
we may apply Theorem 4.3.8 in [|| to conclude that S' is strongly invariant under F. Since a;(0) G S' , 
it follows that x(t) £ S' for all t £ [0, T], and therefore also x[t) £ S for all t £ [0, T], as wanted. 

Proof that 1^2 



Suppose that S is strongly invariant under F, and pick any Co G S. We apply Lemma A. 6, with 
M = {Co}, to obtain F and S' . Note that Mf]S = {Co}, so Co G S' . Then Property (||) gives that 
S' is strongly invariant under F. Since 5' is closed and F is nice, Theorem 4.3.8 in § gives that 
-FXC) £ ^i<5' f° r an C G 5', and in particular for C = Co- By Property (56), either F(Co) = {0} or 
TjrS' = TjrS, so we have that F(£) C 7^5 for C = Co- Moreover, Property (||) gives that F(C) C F(C) 
for C = Co- Since Co was an arbitrary element of S, the proof is complete. I 
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